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(57) A integrated content guide for multiple sources 
is provided with hyper-text type links to allow for the se- 
lection of various programs. The hyper-text links are 
provided for a transmitted and then stored digital bit 
stream. This allows for the embedding within the content 
guide what could be additional commercial information. 
The embedding may also be as to additional information 
for other related television or radio shows or the like. 
Information can be additional television shows, related 
information or activities on on-line services or automatic 
telephone ordering of products or services being dis- 
played. 
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Description 

This invention relates to a novel system and meth- 
odology lor providing information with respect to elec- 
tronic entertainment and more particularly to an infor- 5 
mation program content guide which provides for relat- 
ed services. 

Various text based systems for providing informa- 
tion on television shows and the like are now available. 
However, these devices and/or printed publications are io 
rather limited in their scope. Systems such as the 
VCR+™ system which employs information found in a 
local newspaper, provides a code based system which 
requires that the manual codes printed in a newspaper 
be entered into a VCR to allow automatic programming is 
of the VCR. This system however, does not allow for an 
interactive link of the flexibility that is demanded or need- 
ed by users at the present time. This invention expands 
upon, and provides a significant improvement over, the 
text based preprinted information systems and further 
provides a mechanism by which additional related serv- 
ices and information can be provided to a user. 

Other computer and electronic based systems, 
such as would be found on a cable system, suffer from 
various other problems, such as a lack of interactivity 
and the ability to provide interactive links or for the in- 
formation to be updated in an easy manner. 

A computer based system is provided in this inven- 
tion which may use, for example, a personal computer 
which extracts, consolidates and provides a display 
mechanism for displaying the various types of informa- 
tion to access from multiple sources of electronic signals 
and sources for use by an individual. Although this com- 
puter system is primarily designed to incorporate a large 
screen monitor capable for viewing at a distance, this 
invention should not be considered so limited in its use 
and may in fact, be used in conjunction with monitors of 
all sizes. The computer system of this invention incor- 
porates integrated hardware and functionality in which 
electronic signals from a plurality of sources and of var- 
ious types can be acquired by the computer system's 
central processing unit. The system interprets and proc- 
esses information which is played back and displayed 
to the user. These signals may be acquired from an an- 
alog signal or from a digital signal. Just some of the ex- 
amples of the signal sources might be standard analog 
television transmission, which occurs over the air, cable 
analog television transmissions, digital cable television 
transmissions, and direct broadcast satellites, either 
digital or analog. Additional digital information can be 
carried as part of an analog television signal for exam- 
ple, as part of the vertical blanking interval (VBI) or in 
other portions of the video and audio wave form, includ- 
ing in the picture portion itself. Digital data may also be 
acquired by the central processor by cable modem, sat- 
ellite digital video transmission or over standard tele- 
phone lines, including Integrated Services Digital Net- 
work (ISDN) wireless transmission, AM/FIVl radio broad- 



casts, digital media such as CD ROM, GDI, magnetic 
diskettes or the like. Further additional information can 
be acquired from prerecorded items such as would be 
used in video cassette recorders, audio CD players or 
the like. This information would then be converted either 
from its native analog format or reformatted from its 
stored digital format or transmittal digital format into a 
data format by which the computer may use this infor- 
mation. 

The presentation of this information in a manner 
which is usable by an average user, is one of the signif- 
icant features and advantages of this invention. Specif- 
ically, the computer system acquires information from a 
multiplicity of electronic signals and provides a coherent 
mechanism of presenting this information to a user in a 
format which is easy to understand and suitable for us- 
age. For example, in the case of broadcast television 
signals, these signals are received and converted into 
a moving digital graphical display and the processed 
signals can then be displayed on a system monitor with 
the accompanying audio signals being received and 
converted to digital samples and then replayed through 
the digital display to analog converters provided in the 
system. Obviously, the signal acquisition method and 
apparatus and its processing used to present the signal, 
either visual or aural, will vary depending upon the type 
of signal source that is received and the manner in which 
it is received. 

In the case of digital signal sources, the processing 
method used to interpret and present the signal obvi- 
ously depends upon the type of digital information. One 
of the concerns is how the information is contained with- 
in the data stream or on the context in which the data is 
received. The mechanism by which the signal arrives at 
the computer system obviously may vary as set forth 
above and this invention should not be limited to the spe- 
cific methodology of receiving the signal- 
In any complex computer system which is capable 
of receiving and displaying or playing back audio sig- 
nals, there is obviously a rich and diverse source of sig- 
nals for entertainment and for content. However, it is dif- 
ficult for an individual user to select from the wide se- 
lection of possible programs and content types in an 
easy and expeditious manner. In conventional ap- 
proaches, once a selection is made or in use, it is difficult 
or time consuming to change to or investigate other sig- 
nal/content sources without entering complex com- 
mands. In the case of searching and finding content de- 
livered over different means (for example, switching 
from a television broadcast signal and a modem data 
signal), it may be necessary to consult multiple sources 
of information or "content guides" to determine what ma- 
terial might be of interest to the user and what is avail- 
able. 

Another problem that is present in prior art systems 
is the ease with which actions can be prompted to the 
user on a given signal type and carried out using another 
signal type. An example of this is an advertisement on 
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television containing a teleplione number tor placing an 
order to purchase goods, or a world wide web address, 
which is displayed as part of a television program. The 
conventional method of taking action would be for the 
user to note the telephone number, pick up a telephone, s 
dial the telephone number, request the specific mer- 
chandise and provide credit card information or billing 
information to the operator. If a world wide web address 
is provided on the television show, it may require several 
displays of this address before the user can note the io 
exact syntax of the address, copy it down, enter it into 
his web browser and communicate with this web page. 

One of the unique advantages of this invention is 
an integrated content guide (ICG) with associated fea- 
tures is provided. This content guide provides an inte- is 
grated method for searching and finding content of in- 
terest both within and across pluralities of signal types 
and programming and provides an integrated approach 
for the presentation of this information and of advertising 
information which is sent along with this signal. 

An additional advantage of this invention is a mech- 
anism by which links and/or related information, which 
are (Is) kept in the context of the program being viewed 
or listened to, may be used as part of the content guide. 

Other advantages and novel features of the present 
invention will become apparent from the following de- 
tailed description of the invention when considered in 
conjunction with the accompanying drawings in which: 

Figure 1 is a graphical representation of the type of 
display used in conventional systems; 
Figure 2 shows a graphical display as contemplated 
by this invention; 

Figure 3 shows a graphical display as to what would 
occur when a given link is followed in Figure 2; 
Figure 4 shows a mechanism by which a rearrange- 
ment based upon interest of the display can be ac- 
complished; and 

Figure 5 Is an exemplary display according to this 
invention showing possible television and non-tele- 
vision content items. 

As can be seen from Fig. 1 , a conventional display 
guide shown for example on cable television, lists cur- 
rent and future shows based upon their start times (10) 
and the current time. Some of these guides are partially 
interactive (to a very limited extent) in that a user may 
scroll through the guide manually. However, these types 
of content guides are quite limited in nature and do not 
provide a full measure of flexibility to the user. Further- 
more, the information is not generally stored in any 
meaningful manner, nor is any link provided. 

The integrated content guide set forth in this inven- 
tion is a software application which can run, for example, 
on a general purpose computer which contains informa- 
tion about content availability on a multiplicity of services 
such as television, digital satellite services, or the like, 
as well as other diverse sources such as on-line servic- 



es, Internet sen/ices, searchable databases or other 
programming and information content rich sources, and 
each entry in the content guide may contain information 
about services individually or may combine information 
about service offerings which are related. The content 
guide of this Invention, utilizes a data base containing 
descriptive information about these services. This con- 
tent is then displayed. Furthermore, the data base may 
contain additional information such as advertising 
graphics or special interest messages, as well as em- 
bedded commands which may be accessed to cause 
the computer system to execute a specific action. Fur- 
ther graphical icons and other means to indicate the 
availability of additional information, graphics or embed- 
ded commands are also provided to a user. From a re- 
ceived signal, information is extracted and provided to 
the central processor. The software reads this extraction 
data and forms a data base and provides this informa- 
tion in a graphical manner for the user to navigate. By 
providing this display and the interaction between this 
display and the stored data base, this invention effec- 
tively consolidates and presents a single coherent and 
informative controlling front end which may be used to 
control the computer. This control may allow the user to 
navigate, select or take other actions on the information, 
through the various signal types and diverse services 
provided to the computer system. The Information In a 
grid celt can be a link to an on-line service "program" 
such as a chat session 1000 as shown in Fig. 5. Also a 
selection of an on-line game that might be of interest or 
a "link" to searchable database, such as is available how 
"Time®" magazine could also be made. 

In this Invention, a data base for this invention may 
for example be stored locally on a computer systems' 
magnetic hard drive or in other types of digital memory 
storage devices. The data base will be frequently updat- 
ed to contain updated content information, updated ad- 
vertisements and other Information. This updating pro- 
vides one of the significant advantages of this invention 
in that advertisers may, for example, update promotions 
and the like, as well as updating program information 
which includes changes In program time, length, content 
and the like. The data base digital content is acquired 
and stored on the hard drive utilizing any one of a plu- 
rality of digital data acquisition systems that a computer 
might have. For example, this information can be carried 
within or acquired from the vertical blanking interval of 
a broadcast television signal. It may further or alterna- 
tively be delivered by using a modem which dials from 
the computer to an on-line service or it may be provided 
over a ISDN line, which is kept active, may be provided 
over a cable modem, or from a fixed wide area network 
or on a dedicated radio channel or the like. 

It is contemplated that various modes of display can 
be selected by the user. Each of these modes changes 
the arrangement of the display of the information, such 
as is shown in Figs. 2. 3 and 4. Each of the modes pres- 
entation is contemplated to generally feature a graphi- 
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cally distinct region in the display. These regions, which 
are associated with a particular program or an item of 
interest are shown in Fig. 2, for example. Each of these 
areas are areas which are called "cells" (20). A cell may 
be associated, for example, with an individual television s 
program and could contain the title of a program. 

In a default mode, the cells will be arranged graph- 
ically according to the channel, (I.e., vertical positioning) 
and the time span (horizontal dimension) of a program 
such as is shown in Fig. 2. This is commonly referred to 
as a "grid guide" and is very similar to the grid guide 
shown in Fig. 1. In a typical configuration, a television 
channel number (or other mechanism of identifying an 
individual station) are listed from top to bottom on the 
left side of the display and the time of day is provided in 
equal Intervals from left to right at the top of the display. 
Each of the cells containing a program listing are dis- 
played so as to assume the appropriate channels start 
time and duration coordinates on the display. 

A navigational device, such as an arrow key mouse 
or other type of pointing mechanism, either wired or on 
a wireless remote control, may be used to select or high- 
light a particular cell. 

Additional actions by the user such as pressing the 
button on the remote may be used to cause the televi- 
sion to tune the channel which was selected. The point 
control means on the remote may also be used to cause 
the display to advance or go backward in time or up and 
down through the available channels. In some cases, 
pushing a button will reveal additional information con- 
tained in the program guide. 

The specific method of downloading information 
may vary and several conventional methods are con- 
templated. These methods could include extraction of 
information from the VBI, bulk download from the Inter- 
net or other known methods which have been down- 
loaded and stored by the local computer. 

The integrated content guide and a stored associ- 
ated data base provide an additional graphical presen- 
tation and navigational front end for a user which inte- 
grates diverse content sources and provides embedded 
control over a computer system used to present the con- 
tent. The integrated content guide of this invention is 
unique in that it exploits the fact that it is deployed on a 
general purpose personal computer system. The com- 
bination of the computer functionality along with the tel- 
evision content viewing allows several additional func- 
tional items. 

Specifically, embedded icons (30, 31, 40. 50, 60. 
70, 71 , or 80), such as are shown in Fig. 2, can provide 
links to advertising graphics which are stored locally for 
example on a hard disk or may be down loaded sepa- 
rately from a web sen/er or from other types of sources. 
Additional video or sound which Is stored locally on the 
hard disk of the computer system, may also be dis- 
played or played by the user by highlighting a given link. 
The display of this information after selecting a link can 
be performed in any of the conventional manners. Se- 



lecting an individual icon on the screen can also provide 
an automatic dial out, and submit a request for informa- 
tion from an on-line service or file server. This dial out 
can likewise be accomplished in a conventional manner 
after the selection is made on the video screen. This in- 
cludes the display (using for example either an embed- 
ded browser or an automatically launched separate 
browser application) and following of hypertext markup 
line pages (html) which may have active links which will 
cause further actions in a conventional manner of web 
browsers or by using other types of search engines. 

A further following of different types of links, such 
as is shown in Fig. 3, can be icons, which are placed 
there by the content provider which presents prompts to 
a user for action. For example, a political talk show may 
have poll results provided by prompting Individual view- 
ers for an autodial-in vote on specific questions. 

Auxiliary software located on the personal compu- 
ter and stored on conventional mass storage devices, 
may also be tied to an individual item in the program 
content For example, play-along versions of game 
shows may be delivered along with the program guide 
content, so that the user can play along at home while 
the same game is being played on the television show. 

Further selections may cause the delivery of items, 
such as test versions of programs or in fact, full versions 
of software, if pre-programmed credit card information 
is provided in the system. All of these requests may be 
accomplished by conventional means. However the dis- 
play of this information in a content guide in a manner 
contemplated by this invention, is accomplished by the 
integrated data base arrangement of this invention 
which is also presented in the context of entertainment 
programming information. 

One of the novel and un-obvious features of this in- 
vention is that it provides a means to place advertising 
and/or promotional opportunities where and when they 
can be easily accessed in a user's "moment of interest". 
A moment of interest occurs when a user is attracted to 
the content guide listing because of his/her interest. For 
example the placing of an advertisement to attract a a 
baseball fan in a listing for a baseball game takes ad- 
vantage of the "moment of interest" generated by the 
listing. A "moment of interest" occurs in the context of 
using the guide of this invention, which contains among 
other items entertainment programming information in 
a television framework. 

Each of the cells shown in Figs. 2, 3, 4 and 5 contain 
some type of information about the particular contents 
available from a source. By providing a uniform appear- 
ance of the cells, the sequence of computational steps 
required to access individual contents and services, 
may be aggregated and displayed in a given cell or dis- 
played by an Icon placed within a cell. From the user's 
standpoint, it will appear that a single action, such as 
positioning an on-screen cursor or pointing device over 
a particular icon and then pushing the button is all that 
is necessary. This launching of an action provides a uni- 



15 



20 



25 



30 



35 



40 



45 



50 



4 



7 



EP0 834 798 A2 



8 



form and consistent method to access the listed content 
or service. This launching may also use a conventional 
double click method or may be a voice activated com- 
mand or the like. However, the uniform arrangement of 
selecting an action to be accomplished, is a significant 
feature of this invention. 

Upon selecting an individual icon or a content within 
a cell, various actions are taken. These actions are gen- 
erally conventional in nature. However tying them to a 
given icon on a content guide is new to this invention. 
Specifically, by selecting a given icon within a cell, a tel- 
evision program may be selected, the tuner arrange- 
ment may be forced to a given channel, as well as exe- 
cuting a series of start up commands in the computer to 
select both a video and audio channel, which may be 
provided by separate sources or paths. If an icon such 
as icon 30 is selected, such as shown in Fig. 2, which 
is labeled "chat session", an individual interactive text 
based type of chat or an audio chat arrangement can 
be provided to the user. Selecting this icon would start 
an on-line service software application, provide a pre- 
stored user name into a user named field, start the dial- 
ing to connect to the on-line sen/ice, provide for the con- 
nection to be completed, log on to the on-line sen/ice, 
log on to the given chat session in an automatic matter 
by extracting from the data base the appropriate se- 
quence of commands to execute and attach to a given 
chat session by substituting into this pre-programmed 
sequence of commands, for which the information is 
provided in the content guide. 

In the case of viewing an advertisement or offer of 
merchandise, such as is shown in Fig. 2, an order can 
be placed, for example, for a pizza from a national or 
local chain, by selecting for example icon 40. An auto- 
mated sequence of events performed by the computer 
would then extract a proper telephone number from the 
data base, dial the particular number and place the user 
in a situation where they are in voice contact with the 
pizza restaurant or alternatively, provide for an automat- 
ic selection of the specifications of their desired pizza. 

Additional opportunities or icons may likewise be 
provided on the screen which may be constantly updat- 
ed. These icons are tangible controls used to cause the 
computer to take an action based upon the opportunity. 
These opportunities are defined by the entertainment 
programming context and the interest of a given user. 
Examples of this would be items such as. sports scores 
and the like, which would cause the computer to execute 
a series of commands that are embedded or placed in 
the data base directory, which would then place a tele- 
phone call from the unit's computer modem line to obtain 
the most recent scores. Further context based related 
icons can be used to select sports related memorabilia 
or merchandise, as well as retrieve additional sports in- 
formation . which would have more depth than simply the 
scores, such as who scored. Still further in depth, a se- 
lected icon 80 may provide a link to other commentary 
on such things as team standings in a league, the per- 



formance of a particular player or other statistics for in- 
stance. 

Further the icons may be animated and have three 
dimensional looks or arrangements to them. 
5 The content guide of this Invention provides a single 
point of entry to multiple sources. For example, listing 
the cells will not be restricted to individual television 
channel contents, but may be mixed with other service 
offerings. As an example, the user may have either dig- 
ital satellite delivery, cable access, and conventional 
over the air broadcast offerings. Further, computer 
based text and database systems, such as an on-line 
chat service which could, for example, be provided by 
American On-Line(g> (AOL) or CompuServe® (CIS) (icon 
90), may be presented. This presentation might be next 
to a program listing for a given movie which may be 
viewable either on a conventional broadcast channel or 
in a digital satellite channel. Usenet groups related to 
the program could also be tied to a given cell. Also 
searchable databases could likewise be placed on the 
same screen such as the "Time®" magazine archives 
1010 in Fig. 5. 

Clicking on the chat session cell will cause the com- 
puter to execute those embedded commands which are 
necessary to activate a specified chat session and this 
chat session can be tied directly to a movie cell or other 
television program cell, such as is shown in Fig. 3. The 
video window (100) as shown in Fig. 3 when highlighted 
and selected (for example), would cause the television 
portion of the computer to tune to that channel. This will 
allow a user an easy mechanism to engage in a given 
chat session which is tied to a given television show. 
This also provides a simplified mechanism by which the 
user can select the chat session. By providing an ar- 
rangement in which the chat session is tied to a given 
movie for example, It provides an uniform ease of ac- 
cess for a user. 

Additionally, as part of this integration of multiple 
sources, a given advertiser may provide as part of their 
program, information for example to automatically con- 
nect to a world wide web page or the like, which may 
also be selected by a user without having to retype the 
information. 

By having the computerized data base that is part 
of this invention, it is possible to store information with 
respect to a given user to learn their usage pattern. Log 
files are easily maintained which will store a pattem of 
uses. This information can be used by the computer by 
retrieval of the infomnation from the log files to form a 
data base which is correlated by the computer to deter- 
mine likely settings and preferred channels and pro- 
grams that an individual user might use. As an example, 
if a user four nights in a row watches the 1 0 O'clock news 
on a particular channel, the computer can recognize this 
fact and present an option to the user to turn on either 
immediately before the 10 O'clock news or exactly at 
the 10 O'clock news hour and tune to that channel. 
By issuing an additional command to the system, a 
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rearrangement and resorting of the display of the indi- 
vidual cells can be innplemented. A conventional filtering 
type of command can likewise be implemented so as to 
provide the display in the manner contemplated by Fig. 
4. 



Claims 

1 . A computer system for the display of a selection 
guide for multiple sources of information: 

a means to produce a visual display, said visual 
display comprising of a grid containing guide 
cells; 

a means to place icons in at least some of said 
displayed guide cells; 

means for a user to select from among said dis- 
played icons; and 

wherein said selected icons are linked to exe^ 
cutable instructions which are unique to a given 
icon and which are dependent upon information 
other than said icon displayed in a given cell 
and further wherein said icons distinguish from 
a plurality of possible executable actions that 
said icon represents. 

2. A system as in Claim 1 further comprising: 

means to cause said Icons to selectively appear 
to be animated; and 

means to cause said icons to selectively appear 
to be of a three dimensional nature. 

3. A system for the display of graphical information 
comprising: 

a means to display a graphical image; 

at least one means to receive a plurality of video 

program sources; 

a means to select between said received video 
program sources and to display said sources 
on said graphical device; 
means to reproduce sound; 
means to select from a plurality of sound sourc- 
es and to provide said selected sound sources 
to said means to reproduce sound; 
means to display text; 

means to select from a variety of text sources 
and to provide to said means to display text said 
selected text sources; 

computational means to acquire, from at least 
one incoming signal, digital information to be 
processed into a content guide such that said 
acquired information comprises information as 
to at least some of the content of the plurality 
of video program sources, said plurality of said 
sound sources and said text sources. 



4. A system as in Claim 3 wherein: 

said means to acquire digital information is 
coupled to said means to receive video signals and 
said acquisition Is from information imbedded within 
5 the vertical blanking interval of the received video 
signals. 

5. A system as in Claim 3 or Claim 4, further compris- 
ing: 

10 

processor means to produce graphically linked 
icons, said icons being linked to program ma- 
terial displayed in a grid like manner on said dis- 
play device in response to the digital signals ac- 
15 quired by said computational means; and 

storage means to store said graphically linked 
objects. 

6. A system as in any of Claims 3 to 5 further compris- 
20 ing: 

a modem coupled to said processor means 
for connection to on-line services. 

7. A system as in Claim 5 further comprising: 

25 selection means coupled to said processor 

means for allowing a user to select from and acti- 
vate displayed graphically linked icons . 

8. A system as in Claim 7 further comprising: 

30 hyper-link following means contained within 

said processor means for causing said processor 
to execute a series of software commands based 
upon information stored with respect to a selected 
and stored displayed graphically linked icon. 

35 

9. A system for the display of content for multiple 
sources comprising: 

a central processing unit; 
40 a display circuit coupled to said central 

processing unit; 

a hypertext linking engine coupled to said cen- 
tral processing unit and said display circuit; and 
wherein said hypertext linking engine provides 
45 a command to said display circuit to display in 

a grid arrangement listings as to the content of 
at least two of said multiple sources and icons 
to provide a link to an external resource. 

50 10. A method of selecting information from a plurality of 
information sources connected to a computer sys- 
tem, the method comprising 

displaying, on a display of said computer sys- 
55 tem, a grid of cells, each cell corresponding to 

information from one of said information sourc- 
es; 

displaying, from among a plurality of icons each 
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representing an executable action, one or more 
icons in one or more of said cells, each of said 
icons being uniquely linked to one or more in- 
structions executable on said computer sys- 
tem; 

selecting from among said cells or said icons to 
provide information to the user dependent upon 
the cell or icon selected. 
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